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Overview 


Financial aid plays an essential role not only in allowing many students to enroll in college but also in 
supporting them in attaining completion and success. Often, however, the total amount of aid does not 
come close to covering the cost of attendance for full-time students. As a result, the majority of stu- 
dents enrolled at two-year public institutions report feeling financial stress related to paying for school. 
Students often work while attending college to cover the full cost of attendance, but time spent work- 
ing can have a negative impact on their academic success. 


MDRC launched Aid Like A Paycheck to test whether changes to the timing of student aid disburse- 
ment could help students stretch their financial aid to cover their expenses throughout the term, and 
whether such a policy could improve students’ academic and financial outcomes. Most colleges dis- 
tribute financial aid refunds to students in one or two lump sums during the term. Aid Like A Paycheck 
tested an alternate approach, in which financial aid refunds were disbursed biweekly, with the goal of 
helping students better budget their existing financial aid. 


MDRC conducted a mixed-methods evaluation of incremental financial aid disbursements at two 
community college systems in and around Houston, Texas, and at a third system in California’s rural 
Central Valley. At the two institutions in Texas, the study included a randomized controlled trial that 
gathered data from nearly 9,000 students and tracked them for up to two years. The final findings from 
the study indicate that biweekly disbursements do not result in substantial impacts on student out- 
comes: 


e Students assigned to receive biweekly disbursements and those assigned to receive their aid 
in the standard way received the same total amount of financial aid. 


e Biweekly disbursements reduced students’ debt to the college in the first semester, but this 
reduction in debt was no longer evident at the end of the fourth semester. 


e On average, there is no evidence of biweekly disbursements improving students’ key aca- 
demic outcomes. 


e There is little evidence that the participating colleges or the government saved money by 
implementing biweekly disbursements. 


e Implementation of the policy was costlier than — and not as simple as — expected, even 
when implemented without the constraints of the randomized controlled trial design. 


Overall, the study suggests that incremental disbursements neither hurt students nor substantially im- 
prove their academic or financial outcomes. 
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Preface 


Research shows that college students’ finances affect their academic success, and that providing 
them with additional financial aid can improve their academic outcomes. Given the important 
role that finances play for students, one might also ask whether changes in the way that aid is 
administered — even without increased investment — could improve outcomes as well. 


With this in mind, MDRC and the Institute for College Access & Success (TICAS) 
launched the Aid Like A Paycheck project based on a simple yet potentially transformative idea: 
Instead of providing financial aid to students in one or two large lump sums each term, colleges 
could evenly disburse financial aid refunds (the amount remaining after tuition and fees have been 
paid) to students every couple of weeks throughout the term — like a paycheck. Anecdotal evi- 
dence suggests that students who receive lump sum financial aid refunds at the start of the term 
may work longer hours at a paid job toward the end of the term as their money runs out. The theory 
was that incremental payments would help students manage their limited aid more effectively and 
would enable them to make choices leading to reduced financial stress and improved academic 
outcomes. Incremental payments could also potentially reduce the student debt to a college — or 
the college’s debt to the Department of Education — that can be incurred when students withdraw 
from courses after receiving their financial aid for the term. 


Although the impacts of incremental disbursements were not expected to be large, it was 
hoped that small impacts accumulated over several semesters could give students an important 
boost in their academic progress. Likewise, small cost savings accumulated across millions of 
students could ultimately lead to substantial savings for colleges and the government. On the other 
hand, there was also the potential that the policy could have adverse effects on finances, suggest- 
ing it was important to test for potential unintended consequences as well. 


MDRC partnered with three community college systems to conduct a multiyear, mixed- 
methods study of the impact of biweekly disbursements. The final findings show that incremental 
disbursements neither hurt students nor substantially improve their academic outcomes. Simi- 
larly, the policy does not appear to have an impact on students’ financial outcomes, nor does it 
offer savings for colleges or the government. In short, changing just the timing of financial aid 
does not have a significant impact on student outcomes; instead, bolder changes may be needed 
to exert a positive impact on students’ financial situations and academic success. 


Gordon L. Berlin 
President, MDRC 
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Executive Summary 


Financial aid plays an essential role not only in allowing many students to enroll in college but 
also in supporting them in attaining completion and success.' But even when federal grants and 
loans cover the costs of tuition, fees, books, and supplies, many students lack the means to afford 
the housing, food, and other living expenses necessary to succeed in college.” Such students often 
work while attending college in order to cover these expenses, but time spent working can have 
a negative impact on their academic success.’ Given these challenges, and the growing costs of 
postsecondary education, there is significant national interest in finding ways to use financial aid 
resources more efficiently and effectively to support students’ academic pursuits. 


In standard financial aid practice, colleges first apply students’ awards to tuition and fees, 
then often allow students to use their aid to purchase books at the start of the term, and finally 
disburse any remaining funds as a financial aid “refund.” Anecdotal evidence suggests that many 
students who receive refunds — which can be up to several thousand dollars per semester — use 
this financial aid to pay for substantial expenses, such as rent, car loans, or large credit card pay- 
ments, and the lump sum sometimes runs out before the end of the semester. 


In contrast to the standard financial aid practice of disbursing financial aid refunds in one 
or two lump sums (after tuition and fees have been covered), colleges also have the option under 
current U.S. Department of Education regulations of dividing students’ remaining aid into 
roughly equal incremental disbursements that are paid out throughout the term. This approach 
aims to benefit students without offering additional financial aid, and has gamered broad interest 
and support across the political spectrum, from the Obama administration to House Republicans.‘ 
Aid Like A Paycheck is a study of this alternative approach. 


‘Susan M. Dynarski, “Does Aid Matter? Measuring the Effect of Student Aid on College Attendance and 
Completion,” American Economic Review 93, | (2003), pp. 279-288; Judith Scott-Clayton, Undergraduate Fi- 
nancial Aid in the United States (Cambridge, MA: American Academy of Arts & Sciences, 2017); Benjamin L. 
Castleman and Bridget Terry Long, “Looking Beyond Enrollment: The Causal Effect of Need-Based Grants on 
College Access, Persistence, and Graduation,” Journal of Labor Economics 34, 4 (2016), pp. 1023-1073. 

Jennifer Ma, Sandy Baum, Pender Matea, and Meredith Welch, Trends in College Pricing 2017 (New 
York: College Board, 2017); Sara Goldrick-Rab, Jed Richardson, Joel Schneider, Anthony Hernandez, and Clare 
Cady, Still Hungry and Homeless in College (Madison: Wisconsin HOPE Lab, University of Wisconsin-Madi- 
son, 2018); Center for Community College Student Engagement, Making Ends Meet: The Role of Community 
Colleges in Student Financial Health (Austin: University of Texas at Austin, College of Education, Department 
of Educational Administration, Program in Higher Education Leadership, 2017). 

3See Laura W. Perna, ed., Understanding the Working College Student: New Research and Its Implications 
for Policy and Practice (Herndon, VA: Stylus, 2012); Anthony Carnevale and Nicole Smith, Balancing Work 
and Learning: Implications for Low-Income Students (Washington, DC: Georgetown University Center on Ed- 
ucation and the Workforce, 2018). 

4Fact Sheet on the President’s Plan to Make College More Affordable: A Better Bargain for the Middle 
Class” (2013), website: https://obamawhitehouse.archives.gov; Promoting Real Opportunity, Success, and Pros- 
perity Through Education Reform Act, H.R. 4508, 115th Cong. (2017). In considering such an approach, it is 
important to note that many institutions serve relatively few students with refunds, yet even they could be re- 
quired to make significant changes to their financial aid policies and systems. Nationally, rough estimates suggest 


Biweekly financial aid disbursements — including of federal Pell Grants, loans, and other 
aid — are theorized to help students by means of mechanical changes in the timing and disburse- 
ments of aid as well as through changes in the messaging they receive about budgeting their aid 
to last through the semester. These changes may help students by reducing their financial stress, 
and thereby lower their likelihood of withdrawing midterm, improve their performance in class, 
and reduce their need to take out loans or work excessive hours. In addition, by distributing aid 
as it is earned rather than in advance, biweekly disbursements may lower the debt that students 
sometimes incur when they reduce their course loads or withdraw from college. Such enrollment 
changes can result in student debt to the college or in college debt to the Department of Education 
through a calculation known as the Return to Title [V (commonly known as R2T4).° 


However, the current policy of incremental disbursements uses only existing resources 
to attempt to improve the financial and academic circumstances of students. In evenly distributing 
a student’s existing aid but not offering additional financial support, the procedure the colleges 
followed in Aid Like A Paycheck could not be expected to substantially change students’ imme- 
diate economic position. Moreover, the myriad of influences and communications present at any 
college may limit the influence that one policy can have on students’ behaviors and attitudes. 
Many students also work for pay, receive housing or other support from family members, or have 
other means of sustaining themselves. The aid being refunded is — for many students —just one 
part of their financial situation. 


MDRC launched the Aid Like A Paycheck study to test the hypotheses about biweekly 
aid disbursements by rigorously estimating the impacts of the policy on key student outcomes 
such as total aid received, loans received, student debt to the college, credits earned, and persis- 
tence. Aid Like A Paycheck is a mixed-methods evaluation of incremental financial aid disburse- 
ments conducted at two community college systems in and around Houston, Texas: San Jacinto 
College (San Jacinto) and the Houston Community College System (HCC). The study is supple- 
mented by an implementation study of the policy conducted at the West Hills Community College 
District (West Hills) in California’s rural Central Valley. 


At HCC and San Jacinto, the study used a randomized controlled trial, an evaluation de- 
sign that is widely accepted to yield the most credible estimates of the effects of a program or 
intervention because it makes it possible to estimate not only the outcomes of the intervention but 
also the counterfactual outcomes, or what happens in the absence of the intervention. In Aid Like 
A Paycheck, eligible students were randomly assigned either to the program group, whose mem- 
bers were eligible to receive financial aid under the new biweekly disbursement policy, or to the 


that about half of community college students who receive Pell Grants may receive refunds that are large enough 
for biweekly disbursements; the portion of students receiving large-enough refunds at four-year institutions is 
likely lower. Michelle Ware, Evan Weissman, and Drew McDermott, Aid Like A Paycheck: Incremental Aid to 
Promote Student Success (New York: MDRC, 2013), website: https://www.mdrc.org/publication/aid-paycheck. 


>Title IV of the Higher Education Act, which provides the majority of federal student aid, includes a policy 
that requires the calculation of a R2T4 when a student withdraws from all courses before completing 60 percent 
of the semester. In these instances, colleges can be required to repay unearned aid funds to the Department of 
Education. In turn, colleges may attempt to recoup these funds from students, and may bar students who do not 
repay them from future enrollment. 


standard group (also known as the control group), whose members were eligible to receive finan- 
cial aid under the colleges’ standard aid disbursement policy. 


This research design, while providing rigorous estimates of the policy’s impacts, required 
that the two institutions in Texas each maintain two sets of financial aid disbursement rules in 
parallel, which may have dampened the colleges’ ability to implement the policy. This fact moti- 
vated the inclusion of the third institution in the study, West Hills, where biweekly disbursements 
of financial aid refunds became the policy used for a// students in the 2016-2017 academic year. 
This portion of the study provided additional insight into how the policy of biweekly aid disburse- 
ments works when implemented as a campus-wide policy to supplement the impact study’s re- 
search on how it works when applied to just the randomly selected subsample observed in Texas. 
West Hills also provides insight into how the policy can be implemented in a different setting. 


At all three participating colleges, MDRC researchers collected student-level financial 
aid, account, and academic transcript data for every student in the study sample; conducted focus 
groups and interviews with students, financial aid advisers or office staff members, and adminis- 
trators; and fielded a survey on students’ financial health, attitudes, and behaviors. 


Results from the two Houston colleges at the midpoint of the study, in 2017, presented a 
mixed picture. The colleges were able to implement the mechanics of biweekly disbursements as 
intended; however, college communications about the policy were often unclear to students.° Bi- 
weekly disbursements did not relieve students’ financial stress, but students assigned to receive 
their aid biweekly were not harmed academically or financially by the policy, and on some 
measures were better off than those who received a standard lump sum refund. This report updates 
these findings with research including additional students, longer follow-up, and a deeper look at 
the program’s implementation at West Hills. 


Key Findings 


Based on the data from nearly 9,000 students who were tracked for up to two years at the two 
colleges in the randomized controlled trial, the Aid Like A Paycheck study finds that biweekly 
disbursements of financial aid refunds do not result in substantial impacts: 


e Students assigned to receive biweekly disbursements and those assigned 
to receive their aid in the standard way received the same total amount of 
financial aid. Although there was no average impact on total aid received, 
those students assigned to receive biweekly disbursements were less likely to 
receive federal loans over the course of four semesters. However, this reduc- 
tion in loans appears to be associated with students’ lower persistence into the 
fourth semester at one college, as described below. 


°Evan Weissman, Oscar Cerna, Dan Cullinan, and Amanda Baldiga, Aligning Aid with Enrollment: 
Interim Findings on Aid Like A Paycheck (New York: MDRC, 2017). 


e Biweekly disbursements reduced students’ debt to the college in the first 
semester, but this reduction was no longer evident by the end of their 
fourth semester. 


e On average, there is no evidence of biweekly disbursements improving 
students’ key academic outcomes. An increase in enrollment observed at one 
college was offset by a decrease in enrollment and persistence at the other col- 
lege, and there were no other observed academic impacts. Overall, this finding 
suggests that the policy did not have an impact on students’ academic success. 


e There is little evidence that the participating colleges or the government 
saved money by implementing biweekly disbursements. There are small 
savings in student debt to college in the first semester. However, there is no 
impact on the amount of financial aid colleges had to pay back to the federal 
government, nor is there an impact on the amount of financial aid disbursed. 


MDRC also conducted analyses of the program’s implementation at HCC, San Jacinto, 
and West Hills. The inclusion of West Hills in the final phase of the study provides insight into 
whether campus-wide implementation of the policy could reduce staff burden, support clearer 
communications, and lead students to experience the policy differently. The main findings from 
West Hills follow: 


e Asatthe two Texas colleges, West Hills was able to implement the new policy 
as intended, with most students receiving six to eight refunds over the course 
of the semester. 


e Incomparison to financial aid staff at the sites in Texas, staff from the financial 
aid offices across West Hills reported fewer difficulties implementing and 
communicating about the new policy. 


e Generally speaking, there is little in the findings from the institution-wide 
adoption at West Hills that suggests any major differences from the findings 
at HCC and San Jacinto regarding how students experienced the policy, or 
regarding their financial and academic outcomes. 


Conclusion 


Overall, the study at the two Texas institutions shows that incremental disbursements neither hurt 
students nor substantially improve their academic or financial outcomes. Likewise, the policy was 
not found to have an impact on college or government expenditures in any substantial way. Fur- 
ther implementation was not as simple as expected. Research on the policy at West Hills suggests 
that implementation in this alternative setting — without the constraints of the randomized con- 
trolled trial design — may be simpler, but does not necessarily reduce costs substantially. It also 
does not suggest any major differences regarding students’ financial or academic outcomes. 


Despite these findings, incremental disbursements of financial aid may still be an attrac- 
tive option for some institutions. In fact, two of the three institutions in this study continued to 
disburse aid incrementally to all eligible students in fall 2018. Administrators at San Jacinto and 
West Hills noted that although the research did not show that incremental disbursements have a 
direct impact on student outcomes, they believe that more frequent disbursements — and the 
accompanying recalculations and account reconciliation — ensure that payments to students are 
“more accurate” in relation to a student’s current enrollment. Additionally, they suggested that by 
applying the policy consistently to all of their eligible students, they were able to more clearly 
communicate the policy and thus reduce students’ confusion and complaints about incremental 
disbursements. On the other hand, after the completion of the study HCC maintained the policy 
of one disbursement per semester as the standard for eligible students, noting that the administra- 
tive burdens and challenges of communicating the biweekly policy to students outweighed any 
foreseeable benefits. Regardless, financial aid refunds alone are only a piece of the overall finan- 
cial picture for most students, and many students struggle to cover the full costs of college attend- 
ance. Aid Like A Paycheck demonstrates that changing this economic reality will require more 
than changing the timing of financial aid. 
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About MDRC 


MDRC is a nonprofit, nonpartisan social and education policy research organization 
dedicated to learning what works to improve the well-being of low-income people. Through 
its research and the active communication of its findings, MDRC seeks to enhance the 
effectiveness of social and education policies and programs. 


Founded in 1974 and located in New York; Oakland, California; Washington, DC; and Los 
Angeles, MDRC is best known for mounting rigorous, large-scale, real-world tests of new 
and existing policies and programs. Its projects are a mix of demonstrations (field tests 
of promising new program approaches) and evaluations of ongoing government and 
community initiatives. MDRC’s staff members bring an unusual combination of research 
and organizational experience to their work, providing expertise on the latest in qualitative 
and quantitative methods and on program design, development, implementation, and 
management. MDRC seeks to learn not just whether a program is effective but also how 
and why the program’s effects occur. In addition, it tries to place each project’s findings in 
the broader context of related research — in order to build knowledge about what works 
across the social and education policy fields. MDRC’s findings, lessons, and best practices 
are shared with a broad audience in the policy and practitioner community as well as with 
the general public and the media. 


Over the years, MDRC has brought its unique approach to an ever-growing range of policy 
areas and target populations. Once known primarily for evaluations of state welfare-to-work 
programs, today MDRC is also studying public school reforms, employment programs 
for ex-prisoners, and programs to help low-income students succeed in college. MDRC’s 
projects are organized into five areas: 


* Promoting Family Well-Being and Children’s Development 
* Improving Public Education 

* Raising Academic Achievement and Persistence in College 
« Supporting Low-Wage Workers and Communities 

« Overcoming Barriers to Employment 


Working in almost every state, all of the nation’s largest cities, and Canada and the United 
Kingdom, MDRC conducts its projects in partnership with national, state, and local 
governments, public school systems, community organizations, and numerous private 
philanthropies. 


